Federated Learning Under Importance Sampling
نویسندگان
چکیده
Federated learning encapsulates distributed strategies that are managed by a central unit. Since it relies on using selected number of agents at each iteration, and since agent, in turn, taps into its local data, is only natural to study optimal sampling policies for selecting their data federated implementations. Usually, uniform schemes used. However, this work, we examine the effect importance devise non-uniformly guided performance measure. We find involving without replacement, resulting architecture controlled two factors related variability model across agents. illustrate theoretical findings with experiments simulated real show improvement results from proposed strategies.
منابع مشابه
Importance Sampling for Online Planning under Uncertainty
The partially observable Markov decision process (POMDP) provides a principled general framework for robot planning under uncertainty. Leveraging the idea of Monte Carlo sampling, recent POMDP planning algorithms have scaled up to various challenging robotic tasks, including, e.g., real-time online planning for autonomous vehicles. To further improve online planning performance, this paper pres...
متن کاملImportance Sampling for Reinforcement Learning with Multiple
This thesis considers three complications that arise from applying reinforcement learning to a real-world application. In the process of using reinforcement learning to build an adaptive electronic market-maker, we find the sparsity of data, the partial observability of the domain, and the multiple objectives of the agent to cause serious problems for existing reinforcement learning algorithms....
متن کاملPolicy Learning by GA using Importance Sampling
The most difficult problem of applying GA to a policy learning is that interactions with the environment require much time to evaluate the individuals. In this paper, we propose a new approach to estimate the individual’s value using importance sampling. Importance sampling reuses the experiences obtained by some policy to estimate values of the other policies. The proposed technique cuts down ...
متن کاملImportance Sampling
We describe an application of using a change of sampling density to get easier access to rare events during numeric simulations (this is called importance sampling). Our emphasis is on the derivation of the change of density instead of the algorithmic details. We work a small example to make the technique concrete.
متن کاملFederated Multi-Task Learning
Federated learning poses new statistical and systems challenges in training machinelearning models over distributed networks of devices. In this work, we show thatmulti-task learning is naturally suited to handle the statistical challenges of thissetting, and propose a novel systems-aware optimization method, MOCHA, that isrobust to practical systems issues. Our method and theor...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Signal Processing
سال: 2022
ISSN: ['1053-587X', '1941-0476']
DOI: https://doi.org/10.1109/tsp.2022.3210365